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ABSTRACT 

This project explored the potential of applying the 
technologies of ccmputer-assisted instruction £md expert systems to 
implementation of cognitive and metacognitive strategy instruction 
programs. A prototype program consisting of three computer'assisted 
instruction modules was developed to teach prcK:edures required for 
the use of sKimmlng, summarizing, and notetaXing study strategies. 
After prototype field testing, the modules were adapted from an 
independent study format toward a teacher-directed and/or group-laased 
fcrmat. Hypertext programming was used to provide a structure to 
assist teachers in explaining the steps and rationale of study 
strategies and to prompt the application of those strategies to 
sample reading passages. Expert system programming technology was 
used in a fourth module fo provide a guide for group-l»sed discus nion 
of the application of metacognitive strategies. The fourth module 
demonstrated how the skimming, sufflsarizing, and notetaking strategies 
could I3e used to complete common school tasks, such as preparing for 
instruction, completing written assignments, and studying for tests. 
This program was presented to 69 reading-delayed junior and senior 
high school students in Utah and Wyoming, ^d was largely successful 
in meeting established student learning objectives. Hypertext 
computer-presented instruction alone produced significant increases 
in strategy application scores in two of three strategies for each 
teacher. The expert system-based discussion guides prcxluced 
significant increases in five of six measures of metacognitive 
strategy knowledge. However, with one exception, the prc^ram did not 
produce significant increases in standardized test scores. Appendices 
contain sample tests, instructional scripts, worksheets, and student 
and teacher satisfaction questionnaires, (approximately 45 
references). (PB) 
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COMPUTER- AIDED INSTRUCTION OF STUDY 
AND METACOGNITIVE STRATEGIES 



Abstract 

Researchers have discovered that students with learning 
disabilities have difficulty analyzing academic tasks and 
employing effective performance strategies. There have been 
concentrated efforts in the fields of special education and 
psychology to develop instructional programs to teach these 
students the means for analyzing academic tasks and applying 
useful study and metacogni t i ve strategies. However, they have 
not been extensively used. 

Implementation of tfiese programs has depended heavily on 
teachers' background knowledge in cognitive and metacoqni t i ve 
strategy use and on their rf?sources for producing i n^t ructi ona3 
materials. The difficulties of training teac^u?rs in r-study ^nd 
metacogni ti ve strategies, as» well as the need for them to produce 
wel 1 -^structured instructional presentations have restricted 
implementations of strategy instruction programs. The purpose of 
the present project was to explore the potential of applying the 
technologies of computers-assisted instruction and expert systems 
to alleviate these teacher — related difficulties. 

A review of the literature indicated that computer-assisted 
instruction might provide? teachers with an important 
instructional resource. A prototype program consisting of three 
computer — assisted instruction modules was developed on the 
M-:iCintosh "HyperCard" programming environment to teach procedures 
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required -for the use oi skimming, summarising, and notetaking 
study strategies- 

Initially, these modules were designed to be used 
independently by students. To ensure reading difficulties did 
not interfere with tutorial completion, instructional frame3 wercB 
read to students via synthesized speech software. 

A prototype evaluation was conducted to collect feedback 
related to content deficiencies and to identify potential format 
or design problems. The modules were presented to two reading- 
delayed secondary students in an alternative high school program 
in Rock Springs, Wyoming. Unfortunately, the individualised 
approach to computer-^assisted instruction was found to be 
inadequate for several reasons. First, the technology was not 
sensitive to, and could not anticipate the kinds of responses 
that must be made in the application of study and metacogni ti ve 
strategies- Secondly, the technology did not provide useful 
models for the application of strategies. As the field test 
teacher observed^ "it failed to provide the process experience of 
learning to think through content," 

In view of the feedback received from the field test teacher 
and information gained from a further review of the literature, 
the instructional modules of the prototype program were revised 
to facilitate teacher -di rected and group-based instruction. 
Computer technology i^as used to assist instruction in two ways. 
"HyperCard" programming technology was used to provide a 
structure to assist teachers in explaining the steps and 
rationale of study strategies and to prompt the application of 
those strategies to example reading passages, 
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Expert system programming technology was used in a -fourth 
module to provide a guide -for group-based discussion o-f the 
application of metacogni ti ve strategies. The -fourth module 
demonstrated how the skimming, summarising, and notetaking 
strategies could be used to complete common school tasks, such as 
preparing -for instruction, gathering in-formation -from 
instruction, completing written assignments, and studying -for 
tests. 

A main field test was conducted to evaluate the educational 
e-*f ecti veness of the revised training program, and student and 
teacher satisfaction with the program. The program was presented 
to a total of 89 reading delayed junior and senior high school 
students attending classes at the Logan Middle School in Logan, 
Utah, and Rock Springs High School in Rock Springs, Wyoming. 

The revised training program was largely successful in 
meeting the student learning objectives established for it. 
"HyperCard" computer-presented ins'. ruction alone produced 
significant increases in strategy application scores in two of 
three strategies for each teacher. The expert system-based 
discussion guides produced significant increases in five of six 
measures of metacogni t i ve strategy knowledge. However, with one 
exception, the program did not produce significant increases in 
standardised test scores. 

Applications of computer technology in the revised product 
could be considered successful in addressing many of the teacher- 
related difficulties that have been identified as restricting the 
implementation of strategy instruction programs in the past. The 



product provided a vehicle -for teachers to learn study and 
metacognitive strategies as they initially presented strategies 
to students. It also reduced a d«2mand on teachers' time required 
for the initial preparation o-f structured presentations by 
supplying necessary examples and guides for instruction. 

The product developed was considered to be a means by which 
teachers could systematically initiate instruction in several 
injportant study strategies. It assists this initial instruction 
because it provides examples and a guide for group-based 
discussion. 

In future i mpl ementat i one of the p.oduct, the developers 
would urge users to ensure the content examples used in the 
program were relevant to the content being taught in the class in 
which the program is to usr-d. The developers would also 
emphasi2e the need for teachers to provide additional strategy 
application practice beyond that prompted in the computer-based 
pr ogram. 
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INTRODUCTION 

Students with learning disabilities perform poorly on tasks 
requiring active information proc355ing <Torgesen, 1981). They 
do not attend to or remember central information as well as 
normal peers, and tend to make little use of mnemonic aids, such 
as labeling, verbal rehearsal, clustering, chunking, and 
selective attention. Their difficulty in focusing attention may 
reflect inadequate executive control functions (for example, 
rules and strategies used to understand, remember, and solve 
problems). In fac^, the major problem of students with learning 
disabilities may be an inability to analyze tasks in ways that 
result in the best performance strategy <Sattle?r, 1989). 

Successful students employ strategies as they read. For 
example, they may follov^ a set of specific steps to skim a 
reading passage, develop a list of the key points in the passage, 
and develop an organized set of notes that will enable them to 
remember ar d apply what they have read. More importantly, 
successful students employ what are known as metacogni ti ve 
str-itegies as they solve learning problems. They may analyze and 
characterize a problen. before them, reflect on what they know or 
do not know about solving the problem, devise a plan, and check 
or monitor their progress as they solve the problem. 

Battler, as well as other authors (e.g., Derry, 1990; 
Deschler & Schumaker, 1986; Paris S< Winograd, 1990; Sheinker S< 
Sheinker, 1989) have argued that learning-disabled children can 
be taught to use more efficient learning strategies. Most often, 
two distinct types of strategy instruction are recommended: 



training in the use o-F specific study tactics and training in the 
use of metacogni ti ve strategies (Derry^ 1990) • 

Study tactics can be highly specific and may apply to only 
one or a few types of study tasks. For example, students may be 
taught to direct their attention to headings, topic sentences, 
and other signals provided in a reading passage in order to focus 
their attention on the most important information. Students who 
employ effective study tactics are more likely to discover or 
make use of the organization present in the material. 

Metacogni tive strategies, on the other hand, involve the use 
of broad control processes in problem-solving, such as awarenes?^ 
of one's own cognitive processes or reflective problem-^sol vlng 
activities (Derry, 1990). Metacogni tion has been defined as 
^'knowledge and cognition about cognitive phenomena" (Flavell, 
1979, p. 906). While study tactics constitute the actual 
continuing processes and strategies a person uses to solve a 
problem, metacogni ti on refers both to what individuals know about 
their own cognitions and to the? »^ ability to control those 
cognitions <Mei chenbaum , 1980). A great deal of research 
supports the importance of metacogni tive thinking skills in 
reading comprehension and the application of content information 

(e.g., Brown, Bra;isford, Ferrara S< Campione, 1983? Paris, Wasik Z: 
Van der Westhuizen, 1988; Pressley, Borkowski 8c O'Sulli van, 

1985) . 

There have been concentrated efforts in the fields of 
special education and psychology to develop curricula to teach 
students with learning disabilities useful study and 



metacogni ti ve problem-Bol ving strategies. For ©Kample, McCabe 
(1782) developed a curriculudi for "attacfcing" reading assignments 
and for the instruction of study skills. Schiimaker, Deschler, 
Alley and Warner (1983) developed the "Learning Strategies 
Curriculum," a set of instructional packets to teach students 
with learning disabilities how to acquire information from 
learning materials, identify and store pertinent information, and 
prepare written assignments, Sheinker and Sheinker (1989) 
developed "Metacogni ti ve Approach to Study Strategies," a program 
designed to teach general i sabl e study and metacogni ti ve skills. 
Research supports the effectiveness of these curricula (e.g., 
Deshler S< Schumaker , 1986). 

Difficulties Restricting the Implementation 
of Strategy Instruct i on 

Although curricula have been developed to teach study and 
metacogni tive strategies, their use has not been extensive- In 
fact, studies suggest there has been little strategy instruction 
in special education or remedial settings (Swanson, 1984; 
Ysseldyke, Thurlow, D'Sullivan Z< Christenson, 1989). 

It should be pointed out that, until now, effective 
implementations of study strategy curricula have depended heavily 
on teachers' background knowledge in cognitive and metacogni tive 
strategy use and on their resources for producing instructional 
materials- Palinscar (1990) noted that effective strategy 
instruction depends on teachers' understanding of the specific 
knowledge and skills that underlie performance in academic areas. 
This understanding entails a different kind of knowledge on the 
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part of a teacher. Teachers must be aware of the cognitive 
processes that are recruited by specific academic tasks. 

Also, model :^ ng the use of these processes can be difficult 
for teachers. For example, Duffy (1987) reported that teachers 
have difficulty providing an appropriate level of detail and 
e:<planatian about mental strategies. Pearson and Billingsley 
(19B7> Buggosted that teachers may be reluctant to engage in 
thinking-aloud processes because it is not part of their usual 
teaching repertoire. Modeling these processes may feel awkward 
for them. Deshler and Schumaker (1986) reported that careful 
staff development was required in order zo make using the 
Learning Strategies Curriculum effecti^'e. 

And, effective curriculu^r implementations have depended on 
the ability of tt^acher £ to provide a structured presentation of 
explanations and examples. Derry C1990) indicated that the 
success of strategy instruction depends heavily on the 
development of a wel 1 -structured , considerate instructional 
presentat i on. 

Statement of the Problem 

The difficulties of training teachers in study and 
metacogni ti ve strategies, as well as the need for them to produce 
wel 1 -structured instructional presentations have restricted 
implementations of sitrategy instruction curricula. 
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COMPUTER TECHNOLOBY AND STRATEGY INSTRUCTION 

Two computer technologies may have the potential to 
alleviate the teacher-related difficulties that have restricted 
use of strategy instruction curricula. They ares computer — 
assisted instruction and artificial intelligence programming 
techniques. 

Computer — Assi sted Instruction 

Computer-assi sted i nstructi on actual 1 y consi sts of three 
categories of instructional programs: drill and practice, 
tutorials, and simulations (Gordon et al . , 1984; Hofmeister, 
1983; Vargas, 1986). Most of the computer-assisted instruction 
programs being used in schools today consist of drill and 
practice programs. In fact, there are almost twice as many drill 
and practice programs being used as simulation or tutorial 
programs (Educational Software Evaluation Consortium, 1987). 

Although drill and practice programs are an appropriate 
computer- assi sted instruction application for students with 
learning disabilities (Berber, 1986), other applications may be 
even more appropriate. Tutorial CAI programs are designed to 
teach new subject matter (Vargas, 19S6) . Tutorial programs offer 
an advantage to educators because they provide the means by which 
complcK instructional content can be analysed and presented to 
learners in a logical and comprehensive fashion. Following the 
development of a carefully constructed CAI tutorial program, a 
wel 1 -structured sequence of ej<amples and practice exercises is 
available as a tool for use by a teacher. 
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Educational simulations, on the other hand, are computer 
imitations of processes and offer the means by which students can 
practice the application of newly acquired skills. Vargas (1986) 
recommended the use of simulation programs because they encourage 
active responding and provide continual, immediate feedback and 
realistic consequences. 

Recently, a convenient authoring tool for the creation of 
computer-^-assisted instruction programs has become available* 
"HyperCard," a program that operates on Macintosh computers, 
allows educational programmers to develop and easily modify 
sequences of computer — assisted instruction. 

Computer-assisted instruction programs can provide teachers 
with an important instructional resource. Completed programs may 
be used i ndependent ly • Thus, a teiachc^r may direct students to 
c*:)mplete program sequences in order to obtain necessary review of 
program content. Alternatively, a teacher may direct new 
students to complete program sequences to ''catch up" with the 
remainder of the class. 

Although much has been written about the use of traditional 
computer — assisted instruction programs for students with learning 
disabilities (e.g., Haynes S< Malouf , 1986; Lent, 1983; Meyer, 
1985; Schiffman, Tobin, & Buchanan, 1984) , very few tutorial or 
simulation software programs validated for learning disabled 
students have been located. In fact, the Educational Software 
Evaluation Consortium (1987) could find no software emphasizing 
strategies for effective learning in a review of educational 
software available to schools. 
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In addition, the quality of most eKisting educational 
software is suspect. Members of the Educational Software 
Evaluation Consortium (1987> rated nearly half of the computer- 
assisted instruction software existing in schools as less than 
desirable. Van Lengen (1985) suggested that existing educational 
software may be poor because the authors of these programs may bf? 
unfamiliar with learning theories and proper methods of 
instructional design. To improve the quality of educational 
software, Vargas (1986) identified four basic principles of 
instructional design that should be applied to construct 
effective instructional programs. First, learners should be 
required to demonstrate a high rate of relevant overt responses. 
Second, appropriate cues and discrimination problems must be 
presented such that learners are forced to discriminate between 
appropriate stimuli. Third, immediate feedback should be 
provided such that the consequence of one response precedes the 
next required response. Finally, items must be presented in a 
carefully constructed sequence to teach new behavior. 

Haynes and Malouf (1986) cautioned that students with 
learning disabilities may have difficulty learning from computer — 
assisted instruction programs for the same reasons they have 
difficulty learning from traditional instruction. These students 
may lack the strategies necessary to retain the information 
presented in the visual format of traditional computer-assisted 
instruction. One means by which computer-assisted instruction 
programs may be modified to assist the learning of students with 
learning disabilities is to provide an auditory version of the 
visually presented content. Computers may be programmed to 



"read" instructional -frames to students, via synthesized speech, 
at the same time they are presenting visual in-f ormation. 

Artificial Intelligence Programming Techniques 

Artificial intelligence programming techniques may also 
provide a useful tool in teaching students with learning 
disabilities study and metacogniti ve strategies. Professionals 
in the field of artificial intelligence are concerned with the 
development of computer programs that mimic human characteristics 
such as; understanding, learning, language, reasoning, and 
solvving problems — characteristics commonly associated with .* 
intelligent behavior (Barr ^ Feigenbaum, 1981). The development 
of expert systems, an application of artificial intelligence, 
involve attempts to replicate the decision-making or problem- 
solving processes used by those knowledgeable and experienced in 
a given field (Hofmeister t< Ferrara, 1986). 

Sowizral and Kipps (1986) pointed out that human experts use 
two types of knowledge: "facts, or assertions about their area of 
expertise.,, and... rules of inference that allow them to reason 
within that domain" (p. 28-29 > . Both types of knowledge are used 
to develop expert systems (Stefik, Aikins, Balsar, Benoit, 
Birnbaum, Hayes-Roth, ?< Sacerdoti , 1983). 

Hayes-Roth, Waterman and Lenat (1983) documented 
applications of expert systems to problems in prediction, 
interpretation, diagnosis, remediation, planning, monitoring, and 
instructional tasks. Although expert systems are designed 
primarily to solve problems for the user, this is not their only 
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•function. For example, Waterman and Jenkins (19B6> pointed out 
that an expert system can be used, "as a tool that guides and 
simulates decision-making by its ability to explain the lines of 
reasoning it uses to arrive at each decision it makes" Ip. 95). 

A number of expert systems have been developed for use in 
special education- For example, in 1982 Col bourn developed a 
prototype system to assist in diagnosing children with learning 
disabilities. This system provided the user with a dianostic 
report which could then be used in the development of a remedial 
program. In 1984, Hofmeister developed ''Class. LD," a system 
designed to provide a "second opinion" regarding the accuracy of 
a "learning disabled" classification. Subsequently, diagnostic 
systems were developed to provide second opinions regarding the 
accuracy of "behavior disordered" classifications (Ferrara, Baer , 
?< Althouse, 1987) and "intellectually handicapped classifications 
(Biere, Williams, Ferrara, 1983). Systems have been developed 
to provide instructional programming prescriptions prior to 
placing students in special education iFerrara^ Serna, ?< Baer, 
1986; Haynes, Pilato, Malouf, 1987), and to prescribe the type 
of training needed by regular educators who serve handicapped 
students <Haynes, Pilato, t< Malouf, 1987). Systems have also 
been developed to assess the appropriateness of procedures 
followed in developing an individualised education plan (Parry, 
1986a) . 

Hofmeister and Ferrara C*9S6) emphasized the training value 
of the "intelligent knowledge base" of an expert system. They 
pointed out that this knowledge base is a "model of reality'* and 
can be used to help learners test their diagnostic and 
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cl asei-f ication skills. The knowledge bases of expert systems 
have been used in such simulation-based training programs to 
successfully teach special education concepts (e.g. , Parry, 
19a6b; Prater & Althouse, 1987; Thornburg, Baer , Ferrara, ?< 
Alt house, 198B). 

Halpern (1984) discussed how expert system technology might 
be applied to the instruction of students with learning 
disabilities. Halpern noted that students with learning 
disabilities are often academically unsuccessful because they are 
unable to analyze large problems into simple, basic sub-problems. 
Halpern suggested that because expert system computer technology 
solves complex problems using variations of simple commands, the 
technology "has been used as a powerful research tool in 
investigating... theories of human thinking" ip. 155> and may 
have direct application to instructing students with learning 
di sabi 1 i ties. 

Summary Statement 

In summary, the computer technologies of computer-assisted 
instruction and artificial intelligence programming techniques 
appeared to have the potential to alleviate same of the 
difficulties that have restricted the implementation of strategy 
instruction. The technology of computer — assisted instruction, 
and especially the development of tutorial programs appeared to 
offe" a means by which students could acquire skills in the 
rationale and steps of study strategies. The technology seemed 
to offer the capacity -for the development of wel 1 -structured 
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strategy instruction programs that could be used as a tool by 
both teachers and students. Expert system technology appeared to 
offer a means by which educational simulations of strategy use 
could be developed, allowing students to practice the 
metacogni tive skills involved in the application of learning 
strategies. 

Purpose of the Project 

The purpose of this project was to explore the potential of 
applying the technologies of computer-assisted instruction and 
expert systems to alleviate the teacher-related difficulties that 
have restricted the implementation of strategy instruction. A 
computei- — aided instructional system would be developed to provide 
direct instruction in the rationale and steps of study 
strategies, and practice in the use of metacogniti ve skills as 
strategy steps were applied to common school comprehension tasks. 
It was expected that the product developed would furnish teachers 
with a useful framework fnr the presentation of strategy 
instructioff , preparing them for explaining and modeling the 
application of study and metacogniti ve strategies- 

PLANNING AND DEVELOPMENT OF A PROTOTYPE PROGRAM 
TO TEACH STUDY STRATEGIES 

Pr i or PI anning 

The validated study skills program "Metacogni ti ve Approach 
to Study Strategies,^' by Jan and Alan Sheinker, was selected as 
the basis for the instructional presentations developed in this 
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projec because it provides a useful outline -for instruction in 
study and metacogni ti ve strategy use. The Sheinkers' cur^^iculum 
is designed to teach the study strategies of skimming, 
summarizing, notetaking, and outlining. The curriculum is 
designed to be used in conjunction with content materials 
currently in use in classrooms, facilitating the generalised use 
of study strategies and critical thinking skills across content 
areas. 

Development of a Prototype Program 

Initially, computer — assisted instruction modules were 
designed to be used independently by students. In this 
"individual learning station" (ILS) approach, student were to 
complete modules on their own at a computer work station. These 
initial CAI modules were developed on the Macintosh HyperCard 
programming environment to teach the procedures required for the 
use of the study strategies of skimming, summarising, and 
creating an organized set of notes from academic reading 
material . 

There were -four or five lessons developed for each strategy 
module- The first lesson introduced the rationale for the use of 
the strategy* The following lessons gradually presented 
individual strategy steps and the rationales for these steps. 
The final lessons offered students opportunities to make a 
limited application of the strategy to increasingly more comple^^ 
reading passages. 

Attempts were made to apply principles for the design of 
effective computer-assisted instruction (Vargas, 19B6) • The 
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content o-f strategy instruction modules was analysed and 
presented in carefully constructed sequences. Students were 
required to make a high rate of responses to objective 
comprehension questions concerning the use and rationale of 
strategy steps. For example, students were required to supply a 
missing term to complete a statement about strategy use, and were 
required to identify the portions of a reading passage that 
should be read in skimming the passage. Feedback was provided 
immediately following each student response. To ensure reading 
difficulties did not interfere with tutorial completion, 
instructional frames were read to students via synthesized speech 
software. 

Eval uation Instruments 

The prototype product was evaluated by two means. First, 
comprehension tests were developed to assess students' 
understanding of the rationale and steps of the three study 
strategies under instruction tsee Appendi>i A). Secondly, the 
teacher supervising the preliminary field test w^^s interviewed to 
obtain a qualitative evaluation of the usefulness of the 
tutorials for strategy instruction. 

Product Ob ject i ves 

The objectives of the product included: 

1> Following training, students would demonstrate mastery by 
obtaining scores on the strategy comprehension tests with at 
least 80 percent Siccuracy^ 



2> Teachers would provide positive evaluations of the 
individualized tutorial programs, and indicate a desire to 
continue using the programs in the future. 

PROTOTYPE EVALUATION AND PRODUCT REVISION 

Subjects 

Two ninth-grade students attending the Alternative High 
School program in Rock Springs, Wyoming volunteered to 
participate in the prototype evaluation. Both were below average 
readers. Student ^'A" earned below expected achievement level 
scores in the reading cluster of the Woodcock-Johnson Psycho- 
educational Battery, Part II (eighth-percenti le by age) Student 
*'B" earned below expec^zed achievement level scores in the reading 
total of the SRA Survey o-f Basic Skills C24th percentile by age). 

Data Collection and Procedures 

Before students began each computer-assisted instruction 
module for study strategy instruction, they were pretested using 
the comprehension test developed -for that module. Following 
pretesting, they were instructed how to use the ILS modules. 
They were told to read the information presented on each screen 
of the computer-presented instruction before advancing to the 
ne>:t screen, and to respond to each question presented. 

If a student provided an inco'^rect answer to a question, the 
correct answer was presented, and the program branchRd to review 
the content relevant to the question. The question was then 
presented again • The computer required that a correct response 
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be given -for each question be-fore allowing the student to proceed 
to new material. 

A-fter students had completed all lessons of a strategy 
instruction module, they were posttested. A-fter all modules had 
been completed by the students, the field test teacher was 
queried to identify strengths and weaknesses of the instructional 
approach. 

Resul ts 

As subject's were completing the lessons of the Skimming and 
Summarizing computer-assisted instruction tutorials, it became 
evident that the ILS instructional approach was not satisfactory. 
The final instructional module, Notetaking, was never 
administered. 

Student A obtained a pretest score of 29 percent on the 
Skimming Module. He obtained a posttest score of 100 percent. 
Student B obtained a pretest score of 29 percent on this Module; 
she obtained a posttest score of 86 percent (see Table 1>- 

Student A obtained a pretest score of 50 percent on the 
Summarising Module. He obtained a postest si jre of 60 percent. 
Student B obtained a pretest score of 90 percent on this Modules 
she obtained a posttest score of 70 percent (see Table 1). 
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TABLE 1: Prototype Evaluation Results 



Pretest! 



Posttest : 



Skimming 



Student A 



29 percent 



100 percent 



Student B 



29 percent 



86 percent 



Summar i z i ng 



Student A 



50 percent 



60 percent 



Student B 



90 percent 



70 percent 



The ^ield test teacher observed that the nature o-f ILS 
computer — based instruction is alien to fostering metacogni ti ve 
skills. She noted that ILS instruction is set up in a way that 
there is a "correct answer," and students seek to find the answer 
they believe the teacher wants to hear. 

The teacher commented that the ILS tutorials "look to be 
effective for teaching the procedures required for strategy use," 
but "cannot provide the process experience essential to learning 
to think through content." She cautioned that, as a result, 
"students do not generalise the use of strategies to other 
content . " 

The teacher noted a discrepancy in the learning styles of 
the two subjects. These subjects differed in their degree of 
independence, learning style, and learning speed. She observed 
that one student seemed to attend to the content presented by the 
computer, while the other seemed to "click" his way through the 
material. He responded to multiple-choice exercises by quickly 
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choosing an answer, whether correct or incorrect. He tended to 
continue making errors until a correct answer had been provided 
■for each lesson exercise. Subsequently, he was unable to 
demonstrate mastery of strategy steps on a compreheffSion 
posttest . 

The -field test teacher contrasted the results obtained in 
this evaluation with those she felt could be obtained from group- 
based strategy ins^truction. She noted that, in group-based 
instruction, the teacher serves as a facilitator and does not 
provide ''the correct answer." Instead, students must be actively 
involved in creating their own responses and are more likely to 
generalize the application of strategies to new material. The 
teacher suggested that the observed differences in the learning 
styles of the two subjects would not have presented a problem in 
group-based instruction because group-abased instruction allows 
students to participate *'at their own level*' and benefit from the 
models provided by stronger students.. GrouP'-based instruction 
forces students to analyze and justify their responses. 

In summary, the field test teacher stated, 

"While an attempt is made on the tutorials to require 
students to provide justifications for their responses, they 
are not subject to the intense sel f --evaluation that is 
prompted in the group by both teacher and peers. The group 
interaction is a critical component for which a computer 
program, however intelligent, cannot adequately substitute," 
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Discussion 

The prototype program produced mastery-level scores on the 
Skimming stratei^y comprehension test and failed to produce 
master y-^level scores on the Summari2ing strategy comprehension 
test. However, -"eedback provided by the field test teacher led 
the developers to re--think how computer technology might aid 
teachers in presenting strategy instruct! on • 

As the -field test teacher indicated, the tutorials taught 
only procedures for the use of study strategies. They failed to 
provide the "process experience" of "learning to think through 
content." The tutorials provided only limited opportunities for 
students to apply the strategies they had learned. 

The prototype evaluation revealed that an individual 

learning station <ILS) approach was inappropriate for strategy 
■ 

instruction for at least two reasons. First, present day 
computer technology is not sensitive to, and cannot anticipate 
the kinds o-f responses that must be made in the application of 
study and metacogni t i ve strategies. This technology can only 
test for understanding of comprehension within an "artificial" 
domain of response choices. For example, comprehension of 
reading passages can only be assessed by how well a student 
responds to objective multiple choice questions. Secondly, the 
technology does not serve as a useful model for teaching the 
application of strategies- 
Students' effective use of study and metacogni ti ve 
strategies rests on their ability to "construct" responses while 
reading. Students must be able to provide answers in their own 
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WDrds, and paraphrase what they have read. They must be able to 
argue why they have given a particular answer in response to a 
sel-f-study question, and why they have created a particular key 
point -for a summary. 

The research literature supports the suggestion received 
•from the field test teacher that strategy instruction should be 
mort? effective when conducted in a group setting* For example, 
reciprocal teaching (Palinscar S< Brown, 1984) emphasizes 
interactive communication and a mutual flow of information. This 
i nstruictional approach concentrates on four strategies for 
fostering and monitoring reading comprehension — predicting, 
questioning, clarifying, and summarizing. These strategies are 
embedded in training sessions in which the teacher and students 
take turns leading a dialog concerning the text. Palinscar and 
Brown found that "talking about thinking" helped students to 
summarise relevant information and detect errors in the text. 
They also found that s;tudents transferred these strategies to 
lessons in science and social studies. 

In the instructional approach of cooperative learning, 
students work together to complete tasks (Webb, 1982). One of 
the variables used to explain the positive effects of cooperative 
learning is the fact that when students give and receive help, 
they learn about strategies, metacogni t i on , and motivation from 
each other (Newman, 1990). 

Paris and Winograd (1990) suggested that the oral discussion 
that takes place during cooperative learning can help members of 
a group learn because it prompts debate and the restructuring of 
ideas. Even disagreements may help individuals seek new 
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information, or consider old information from a new perspective. 
In addition, as Webb (1982) found, students in cooperative 
learning situations may be more motivated and less anxious than 
students working in other instructional settings. 

Metacognitive Approach to Study Strategies <MASS, Sheinker S< 
Sheinker, 1989) also makes use of a group setting. In this 
program, the classroom teacher is a facilitator who operates as a 
model and catalyst for student learning. Students are taught to 
apply study strategies to the content tej;ts already in use in 
their classroom. 

At the beginning of each MASS instructional session, the 
steps of a strategy under instruction, and the rationale for 
those steps are reviewed- Students are then directed to 
independently apply the strategy under instruction and create, 
for example, a r.et of answers to self -study questions or a set of 
key points. After students have applied the strategy, a group 
probl em^sol vi ng discussion begins. 

In this discussion, students cooperatively create a set of 
answers or key points to be listed on the classroom blackboard. 
Each student's daily grade depends on how well their own answers 
or key points correspond to those cooperatively created. As a 
result, students are motivated to have their own answers and key 
points considered. However, before a student's answer or key 
point can be accepted by the group, the student must provide a 
justification for it. 

Under these conditions, a great deal of critical thinking is 
modeled for the class by those seeking to have an answer or key 




20 



2». 



point accepted. In addition, every member of the class is 
motivated to be involved in the problem-solving process. 

Group-based instructional approaches provide useful models 
of strategy application and the means by which "constructed" 
response?! can be evaluated. However, these approaches depend 
heavily on teachers' background knowledge in cognitive and 
metaccgniti vB strategy use and on their resources for producing 
instructional materials. 

In view of feedback received from the field test teacher and 
information gained from a further review of the literature, the 
developers sought to revise the program. The computer would be 
used to provide a structure far the presentation of initial 
instruction in strategy use. It would also provide a guide for 
the application of strategies in group discussions. The 
developers recognised the need to place responsibility for the 
management of class discussions, and the evaluation of student 
responses with the teacher. 

Product Revision 

Instructional modules of the prototype program were revised 
to facilitate teacher-directed and group-based instruction. In 
the revised program, four units of instructional materials were 
prepared. In the first unit, students learned how to apply a 
skimming strategy to locate the most important information in a 
reading passage and answer the self -study questions. In the 
second unit, they learned to apply a summarizing strategy to 
identify the key points in a reading passage, develop a set of 
paraphrased key points, and modify their set to develop a written 




summary- In the third unit, students learned to identify 
important information and supporting details in a reading passage 
in order to develop an organised set of notes. In the final 
unit, students were taught methods for selecting an appropriate 
strategy and applying it to common school tasks* 

Computer technology was used to assist instruction in two 
ways. In both applications, computer instructional frames were 
broadcast to the class via a Kodak Datashow device and overhead 
projector, 

"HyperCard" prugramminc, cechnolorjy was used in the first 
three units to provide a structure io assist teachers in 
e.splaining the steps and rationale of study strategies and to 
prompt the application of those strategies to enample reading 
passages. HyperCard technology was used in the final unit to 
assist in describing four important school tasks (preparing for 
instruction, gathering information from instruction, completing 
written assignments, and studying for tests) and how the 
skimming, summarising, and notetaking strategies could be used to 
complete those tasks- 

Also, in the final unit, "expert system" programming 
technology was used to provide a guide for group-based discussion 
of the application of metacogni ti ve strategies* A combination of 
procedural and artificial intelligence computer code was used to 
generate a variety of '"scenarios" in which imaginary students 
responded to examples of the school task problems of preparing 
for instruction, gathering information from instruction, 
completing written assignments, and studying for tests. These 
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scenarios were displayed to the class, and students were asked to 
discuss the appropriateness o-f the procedures followed in 
completing the problems. This system enabled teachers to model 
how metacogni ti ve strategies might be applied to solve school 
tasks, and allowpd students to discuss the application of those 
strategi es. 

Strategy Instruction 

The first lesson of each study strategy unit began with a 
presentation of the rationale for the use of that strategy. 
Steps of the strategy were reviewed by the class. As strategy 
steps were introduced to students, rationales for those steps 
were presented. 

In the early lessons of a strategy unit, the class as a 
group applied the steps of the strategy to an e;<ample reading 
passage. Example reading passages v<aere chosen to be 
representative of typical classroom reading material. In later 
lessons, this level of prompting was faded, and students 
completed strategy steps independently. Following the 
application of each step, the rationale for the use of the step 
was reviewed. The lessons of each strategy unit ended with a 
review of the rationales for strategy steps, and class discussion 
of those rationales. 

As recommended by the Sheinkers, responses to study problems 
were "brainstormed" by the group, and the group discussed how the 
strategy being taught helped to find those answers. For example, 
in the Skimming Unit, the class brainstormed the answers to 
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reading passage questions and discussed how skimming strategy 
steps were useful -for finding those answers. 

Prompting of Student Responses 

Critical oral and written responses were prompted throughout 
each unit of instruction. Far example, the computer pretsentat i on 
d&veloped for the Skimming Unit quided teachers to prompt oral 
discussion following the presentation of each three or four 
frames of instructional content (see AppcndiK B for a sample of 
instructional script). 

As the steps of the Slamming strategy were applied to a 
reading passage, students v-^fere e;<pected to identify steps 
completed, identify the pDrtJoni.-: of a reading passage being 
skimmed, and write answfc-rs to f -study questions on a lesson 
workt-heet (see Apperidi:; C- for sample lesson worksheet). 
Finally, students w(?>re i-?;:pec:ted to complete a written posttest in 
which understand i I ici oi lei;v-Dn content was evaluated (see Append! k 
D far a sample lesson content qui::). 

The student responi^es that resulted from this prompting 
allowed teachers to evaluate how well students had mastered the 
content taught in each lesson and how well students could apply 
that content. These responses enabled teachers to decide when 
and if lesson content should be reviewed. 

In summary, the developers sought to provide a convenient 
means by which teachers could systematically teach study strategy 
steps and their rationales, model the use of a strategy, and 
encourage independent application. 
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Eval uat i on I nst r ument s 

The revised product was evaluated by five means. First, the 
ability o-f students to apply the skimming, summarising, and 
notetaking study strategies was evaluated by asking them to 
correctly answer self^study quei^tions, prepare summaries ot key 
points, and creates organised set^ of notes from rt:Dpre^Eentati ve 
reading passages (see Appendix E for a sample evaluation 
i nstrument > - 

Secondly, th€? ability of students to correctly identify the 
steps of metacogni t i ve learning strategies that should he applied 
in completing the school t^^sks of preparing for instruction, 
writing rc?ports, and studying for tt-sts w^is assesrucd (st.^e 
Appendix F for c\ sample evaluation instrument). 

Thirdly, four subtests of the SRA Survey of Ba-jic Ski 11^:^ 
(readifig vocabulary, rvi^ading compr eh€:?nsi on , social studiei>n and 
science) were admi ni -^^t^^red before and after the 'intire sirateqy 
instruction intervention to yield five standardized measures of 
academic achievement U.e,, reading vocabulary, reading 
comprehension, reading total, social studies, and science). 

Fourth, a student satisfaction questionnaire was developed 
(see Appendix G) • The questionnaire provided four statements on 
which a student could express agreement or disagreement (by 
providing a rating for each statement on a five point Likert-type 
scale where 1 - disagree, 3 - no opinion, and 5 - agree). 
Statements assessed whetht^r or not students liked the tutorials, 
learned from the tutorials, would use the content of the 
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tutorials in other classes, and would like to try morv le^^sons of 
the type included in the tutorials. 

Finally, a teacher satisfaction questionnaire was developed 
to obtain a qualitative evaluation of the usefulness of the 
computer product for strategy instruction (ree Appendix H) . This 
questionnaire asked "open--ended^' questions concc^rning, for 
e>iample, the helpfulness of the product as a teaching aid, the 
instructional value of the product, and how the product could be 
improved. 

F'r oduct Ob jecti ves 
The objectives of the revised product included: 

1) Following training, studt^nt':^ would achic.'ve significantly 
improved scores on the iniiatrunient developed to as'sess study 
strategy application skills. 

2) Fnllov^iing training, students wou3 d achieve r^i ani f i *:ant 1 y 
i inproved scores on the instrume^nl: developed to a*3sess 
fnf-^tacoqni ti ve learning strategy application skills. 

3) Following training, studcnt^^ would achieve significantly 
improved scores on the five measures available from the SRA 
Survey of Basic Skills. 

4) A majority of students would indicate satisfaction with 
the product (by providing an average Li kert"-scal e rating of 
greater than 3.0 in response to the four statements on the 
student satisfaction questionnaire) . 

5) Teachers would indicate that the product w-,s useful to 
them as an aid for strategy instruction. 
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MAIN FIELD TEST 



Subjects 

A tocal of 89 reading delayed junior and senior high school 
students volunteered to participate as subjects in the main -field 
test. These students attended the classes o+ two volunteering 
■field test teachers. 

Fifty-two subjects v-jere reading delayed students attending 
three sixth-grade Chapter One reading classes at the Logan Middle 
School in Logan, Utah. This group achieved the following mean 
pretest scores <in grade equivalents) on subtests of the SRA 
Survey of Basic Skills: 





Mean : 


St. Dev.: 


Range: 


Reading Vocabul ary 


5. 2 


1.0 


3.0-6.7 


Readi ng ComprehenBi on 


5.3 


1.8 


2.4-9.8 


Reading Total 


W ■ Jim 


1.2 


3. 1-7.9 


Social Studies 


5.2 


1.3 


3.0-7.8 


Science 


5. 1 


2.2 


2.7-12.7 



Thirty-seven subjects were reading delayed students 
attending three special materials classes at the Rock Springs 
High School in Rock Springs, Wyoming. Of the 37, 19 were 
identified as learning disabled and five were identified as 
behavior disordered or seriously emotionally disturbed- This 
group achieved the following mean pretest scores (in grade 
equivalents) on subtests of the SRA Survey of Basic Skills: 
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Mean! 


St . Dev. : 


Range: 


Reading Vocabulary 


8.6 


1.7 


4.9-12.7 


Reading Coruprehensi on 


6.5 


1.8 


3.5-11.0 


Reading Total 


7.6 


1.5 


5.2-11.3 


Social Studies 


8.4 


2.4 


4.3-12.7 


Sci ence 


(data 


unavai 1 abl e) 



Research Design and Procedures 

Be-fore training began, the program developers instructed the 
main -field test teachers in how to use the computer-based 
strategy instruction program and when to adtuinister the 
evaluation instruments. 

Students were administered -four subtests o-f the SRA Survey 
o-f Basic Skills before they began training. 

A one-group pretest-posttest research design (E^org 5J< Ball, 
1983) was used to evaluate the extent to which the product met 
its performance objectives in each o-f the junior and senior high 
school groups. Before each unit o-f the study strategy curriculum 
students were administered the first of three versions of the 
strategy application test developed for that unit (pretest). The 
teacher used the HyperCard computer-based program to introduce 
and explain the steps of a study strategy and rationale for those 
steps, and to prompt application of the strategy, as well as to 
guide participation in discussion of the application. Following 
the computer — guided instruction, students were administered a 
second version of the strategy application test (posttest #1). 

Subsequently, the teachers duplicated the strategy 
instruction approach to provide students with practice in 
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applying the strategy to classroom content materials. This 
practice period lasted for approKi mately one week. At the 
conclusion o-f this practice, students were administered the -Final 
version of the strategy application test (posttest #2). 

These procedures were followed for each of the skimming, 
summarising, and notetaking strategy instruction units. 

Before each lesson of the final unit. Using Skimming, 
Summarizing, and Notetaking, students were pretested with the 
metacogni ti ve learning strategy application test. The teacher 
used the HyperCard computer-based program to describe four 
important school tasks, and how the study strategies learned in 
earlier units could be used to complete those tasks. The teacher 
used the expert system computer-based program to guide group- 
based discussion of the application of metacogni ti ve strategies. 
Following the computer — guided discussion, students were 
posttested with the metacogni ti ve strategy application test. 

After students had completed all units of the study and 
metacogni tive strategy instruction program, they were posttested, 
using the SRA Survey of Basic Skills. 

Resul ts 

Study Strategy Application Skills 

To evaluate the effectiveness of the HyperCard computer- 
based program in improving students' skills for applying the 
skimming, summarising, and notetaking study strategies, two- 
tailed repeated measures t-tests were applied to make three "a 
priori" comparisons: 



Comparison Is between pretest scores and scores obtained 
"following the computei' — based presentation <posttest 1>; 

Comparison 2: between posttest 1 scores and scores obtained 
following class practice (posttest 2); and 

Comparison 3; between pretest scores and posttest 2 scores. 

Comparison 1 evaluated the e-ffect o-f computer-presented 
instruction alone. Comparison 2 evaluated the effects of 
additional improvements due to class practice following the 
computer — presented instruction. Comparison 3 evaluated the 
effects of the combination of both the computer-presented 
instruction and the class practice that followed. 

Skiinming Strategy Instruction. 

Teacher "I". Tests revealed that posttest 1 scores were 
significantly greater than pretest scores. Posttest 2 scores 
were statistically equivalent to posttest 1 scores. Posttest 2 
scores were significantly greater than pretest scores (see Table 



2) . 



Table 2: Skimming Strategy Instruction (Teacher "I"> 



Mean: 



St. Dev. : 



pretest 



4. 1 



3. 1 



Comparison 1 



posttest 1 



6. A 



3.7 



(t = 4.53; df 49|i 

two-tailed critical value for p 



.05 = 2.01) 
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Comparison 2 



Comparison 3 



posttest 1 6.5 3.7 

posttest 2 6. 1 4. 4 
(t = 0.79; df = 47; 

two-tailed critical value for p < .05 = 2.01) 

pretest 4.2 3.1 

posttest 2 6.2 4.5 
<t ~ 2-96; 'M - 46; 

two-tailed critical value -for p < .05 = 2.01> 



Teacher "S". Tests revealed that posttest 1 scores were 
statistically equivalent to pretest scores. Posttest 2 scores 
were si gni -f i cant I y greater than both posttest 1 scores and 
pretest scores (see Table 3). 

Table 3s Bkiniming E-itrateciy Instruction (Teacher "S") 

Mean: St. Dev. : 

pretest 12.4 3.5 

posttest 1 12,8 3.6 

(t = 0.66; df == 32; 

two-tailed critical value -for p < .05 = 2.04) 



Comparison 1 



Comparison 2 



Comparison 3 



posttest 1 12.9 3.3 

posttest 2 14.4 2.9 

(t = 2. 17; df --- 26; 

two-tailed critical value -for p < .05 = 2.04) 

pretest 12.9 2.6 

posttest 2 14.5 2.7 

<t - 3.74; df = 30; 

two-tailed critical value for p < .05 = 2.04) 
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Summarising Strategy Instruction 

Teacher "I". Tests revealed that posttest 1 scores were 
significantly greater than pretest scores. Posttest 2 scores 
were statistically equivalent to pcsttest 1 scores. Posttest 2 
scores were significantly greater than pretest scares (see Table 
4> . 

Table 4: Summarising Strategy Instruction (Teacher "I") 



Comparison 1 



Comp^^r i son 



Mean: Bt. Dev.: 

pretest 1.1 1-7 

posttest 1 2.0 1.6 
(t = 2.70; df ^ 34; 

two-tail fc?d cr iticcil value -for p < .05 = 2.03) 

posttest 1 2.1 1 . 7 

posttest 2 l.B 1.8 
(t = 1.01; df - 32: 

two-tailed critical value for p < .05 = 2.04> 

pret«?st 1.1 1-6 

posttest 2 1.9 1.6 
(t ~ 2.49; df = 36; 

two-tailed critical value for p < .05 = 2.03) 



Teacher "S". Tests revealed that posttest 1 scores were 
significantly greater than pretest scores. Posttest 2 scores 
were statistically equivalent to posttest 1 scores. Posttast 2 
scores were significantly greater than pretest scores (see Table 
5) . 
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Table Ss Summarising Strategy Instruction (Teacher "S") 



Mean: 



St . Dev. : 



Comparison 1 



Comparison 2 



pretest 
posttest 1 



1.0 



5.2 



1 . 4 
2.9 



<t = 6.99; df == 28; 

two-tailed critical value for p < .05 = 2-05> 



posttest 1 
posttest 2 



5.3 
5. 3 



2. 8 



(t - 0.00; = 26; 

two-tailed critical value -for p < -05 ^ 2,06) 



Comparison 3 



pretest 
posttest 2 



1.0 
5. 1 



(t ^ 6,71; df 28; 

two-tailed critical value ior p 



1,4 
2.8 

.05 ^ 2.05) 



Notetaking Strategy Instruction 

Teacher "I". Tests revealed no significant differences 
between pretest, postte^st 1, and posttest 2 scores (sec? Table 6) 

Table 6: Notetaking Strategy Instruction (Teachc?r I" ) 



Comparison 1 



pret€?st 
posttest 1 



Mean: 



3. 1 



Bt* Dev.: 
2.9 

2-7 



(t = 0. 10; df 38; 

two-tailed critical value for p < .05 = 2.03) 



Comparison 2 



posttest 1 
posttest 2 



4.5 



2. 7 
4.4 



(t = 1.70; d-f = 39$ 

two-tailed critical value -for p < .05 



= 2.03) 
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pretest 3.5 3.4 

Comparison 3 

posttest 2 4.5 4.4 

(t = 1. 19; df = 38; 

two-tailed critical value -for p < .05 = 2.03) 

Teacher "S". Tests revealed that posttest 1 scores were 
significantly greater than pretest scores, posttest 2 scores were 
signi-f icantly greater than posttest 1 scores, and posttest 2 
scores were significantly greater than pretest scores <S£?e Tab-e 
7) . 

Table 7s Notetaking Strategy Instruction (Teacher "S") 

Mean: St . Dev. : 

pretest 4.9 2.6 

posttest 1 6.8 3.5 

(t = 2.55; df = 17; 

two-tailed critical value -for p < .05 - 2.11) 



Comparison 1 



Comparis .i 



Comparison 3 



posttest 1 6.8 3.5 

posttest 2 10.2 3.9 
(t = 4.08; df = 17; 

two-tailed critical value for p < .05 = 2.11) 

pretest 5.1 2.6 

posttest 2 10.3 3.7 
<t = 6.35; df = 17; 

two-tailed critical value for p < .05 = 2.11) 
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Summary Strategy Application R«Bi»lts 

In sufflfflary, compar i »on 1 •5howi?d that computcr-proccntod 
instruction Alone produced significant increasett in ttkimming and 
wimmarizing application scores iar latudwnta of t»achisr and 
signi + icant increasBS in summtfrisino #ind nntetaking appJicfition 
scores for students of teaclisr "S". nomparison 2 showed that 
ctdditional cIass practice failed to prodiici? significant incrR£»3c?»i 
in any of the »tr«iteqy application acoreja for »tude»ntB of tpachpr 
"1", but produced signif iccint increa««'=ia in skimming and 
noietaking application ©cores far Btudent-.B of te^acher "S". 
Finally, Comparieoii 3 nhoMPd that the combination of both 
rumput©r-pr??9Pntrd Instruction and class practice produced 
signjficant increases in skimming and summarisiny application 
•=irori?« for students of teachesr "I", and iilgnjfin«nt Inrr^amcfi in 
oil three strategy application 5ir:nrps for student!? o-f teacher "il 
(fsce Table 6> . 



Table B: Study ntrritegy Application Scores 
Significant "a priori" Cumpari!*Dn Findinu's 

Comporiison J Cpniparieon 2 Compariuon 3 

{prcttvBt (poEittoBt 1 (pr«l:«?»t 

tb to to 

po'htteat 1> po'jttest 2) pos^ttuiMt 

Skimming 

Teacher "I" significanl si gnl f J cant 

T»«chQr "S" significant aigni f icaitt 
fauffiinarS zi ng 

Teacher "I" significant »*iyni f iurtot 

Twarhc?r "S" ssignificant lilgni f icr^nt 
Notetaking 

Teacher ""i" ' * 



Teacher "S" significant significant significant 




Metacogni ti ve Learning Strategy Application Skills 

To evaluate the e-f -f ect i veness o-f the expert system-based 
guide -for group discussion of the application of metacogniti ve 
learning strategies in completing school tasks (preparing for 
instruction, writing reports, and studying for tests), two-tailed 
repeated measures t-tests were applied to coiTipare students' 
pretest and posttest scores. 

Preparing for Instruction 

Tests rf?vGaled that the posttest scores of students in the 
classes of Teacher "I" wt?'re significantly greater than their 
pretest scores. The posttest scares of students in the classes 
of Teacher "S" were also significantly greater than their pretest 
scores (see Table 8). 

Table 8: Metacoqni 1 1 ve ^Strategy Instruction: 
Preparing for Instruction 

Mean: St . Dev. : 

pretest 15.3 2.8 

posttest 16.3 3.0 

(t = 2. 15; df = 38; 

two-tailed critical value for p < .05 = 2.02) 



Teacher "I" 



Teacher "S" 



pretest 14.8 3.9 

posttest 16.9 2.8 

(t = 3.29; df = 19; 

two-tailed critical value for p < .05 = 2.09) 
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Writing Reports 

Tests revealed that the post test scores o-f students in the 
classes of Teacher "I" vMere signi-f icantly greater than their 
pretest scores. The posttest scores o-f students in the classics 
of Teacher "S" were also significantly greater than their pretest 
scores (see Table 9). 

Table 9: Metacogni ti ve Strategy Instruction: 

Writing Reports 

Mean : St . Dev . : 

pretest 10.4 2.4 

Teacher " I " 

posttest 12.0 1.9 

(t " 4.90q df ^ 35? 

tv-jo-tai 1 f--d critical value -for p < . O^^j 2,03) 
pretest 10.3 2.1 

Teacher "S" 

posttest 13.1 1.9 

<t " 4.53; d-f 15; 

two-tailed critical value -for p •. , 05 -= 2.13) 

Studying -for Tests 

Tests revealed that the posttest scores of students in the 
classes of Teacher "I" were not statistically different from 
their pretest scores. However, the posttest scores of students 
in the classes of Teacher "S" were significantly greater than 
their pretest scores (see Table 10). 
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r»<.«m«.«ry of Mwtacpgni ti ve Strategy Appl i catian Ri^t.ul t-.i 

In Bummary, fcaata revaaled that the "Preparing for 
Inctruction" tjuids protJucec! siflni-f icwit iiii.reasRi»i»» Jn «ppAi cation 
Bcores -lor student© oi both t»»chRr "T" and teacher "8". The 
"Writing RBport«" gui d» produced significant increasBB in 
application ncores for students of both teacher "I" and teacher 
"S". Th«9 ••Btiiriying for Tests" yuide f«i3ml to produce 
significant i ncrfeaseti in appliCcAtion gcorRS fnr studefrttts of 
teacher "I", but prnductd oignif leant lncriea»»s in wpplirAtion 
•Jicoraa for studfentis of tcarlitor "S". 




Table 10: Metacogni ti ve Strategy Instructions 

Studying for Tests 



Teacher "I 



Teacher "S' 



pretest 

pDSttE-St 



Means 



13.2 



13.7 



St . Dev. ! 
2.6 
3.9 



(t 0.94; d-f - 26; 

two-tailed critical value for p < .05 = 2.06) 



pretest 
posttest 



12.9 
14.4 



2. 1 



(t - 2.44; df = IS; 

two-tailed critical value for p < .05 = 2.10) 



Standardised Te?3t Results 



To evaluate improvements in academic achievement, repeated 
flieanures t-tests were applied to make comparisons between the 
■five sets o-f pretest and posttest scores available from the SRA 
Survey of Basic Skills (reading vocabulary, reading 
comprehension, reading total, social studies, and science). 



Reading Vocabulary 

Tests revealed that the reading vocabulary posttest scores 
(reported in grade equivalents) of students in both the classes 
of Teacher "I" and Teacher "S" were not significantly different 
from their pretest scores (see Table 11). 
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Table 11: Standardized Test Results: 
Reading Vocabulary 



Means 



St , Dev . 



Teacher ''I" 



pretest 
posttest 



5.5 



<t = i.88; d-f - 37; 

two-tailed critical value -for p 



1.0 
1.3 



.05 



= 2.02) 



Teacher "S' 



pretest 
poBttest 



8.5 

8.8 



(t = 0.80; df = 29; 

two--tailt?d critical value -for p 



1.7 
2. 1 

.OS = 2.05) 



Reading Comprehension 

Tests revealed that the reading comprehension posttest 
scores (reported in grade 'I'qui val ents) of students in both the 
classes of Teacher "1" and Teacher "S" were not significantly 
different from their pretest scores (see Table 12). 

Table 12: Standardised Test Results: 
Reading Comprehension 



Teacher 



pretest 
posttest 



Mean ; 



5. 1 



4.7 



St. Dev.: 
1.6 
1 . 7 



(t = 1.35; df = 38; 

two-tailed critical value for p 



05 = 2.02) 



Teacher "S' 



pretest 
posttest 



6. J 
6.7 



(t = 1.09; df - 28; 

two-tailed critical value for p 



1.7 



,05 = 2.05) 
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Reading Total 

Tests revealed that the reading total posttest scores 
(reported in grade equivalents) of students in the classes of 
Teacher "I" were not significantly different from their pretest 
scores. However, the posttest scores of student in the classes 
of Teacher "B" were significantly greater than their pretest 
scores (see Table 13) . 

Table 13: Standardized Test Results: 
Readi ng Total 

Mean: St. Dev. : 

pretest 5.0 1.1 

Teacher "I" 

posttest 5.1 1.3 

(t - I -01; df 32; 

two-tailed critical value for p < -OS - 2.04) 
pretest 7.4 1-4 

Teacher "S** 

posttest 7-8 1.9 

(t ^ 2. 14; df 28; 

two-tailed critical value for p < .OS ^ 2.05) 

Social Studies 

Tests revealed that the social studies posttest scores 
(reported in grade equivalents) of students in both the classes 
of^ Teacher I " and Teacher "S" were not significantly different 
from their pretest scores (see Table 14). 
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Jxtendsd Pag.e 



Jn tsumniary, tfsntr> rf>vf=-;>lcri thflt. thr? ovc?rsU .'csvi&ett '.-strat nriy 
insitruclion prngr;*m failori Id product? «i gn,i fi rani: i ni:i-£ja«ftfi9B i n 
aiiy aubtast «norf? -for sl'iultin1.« o-f t^'a^ht9r "V, sir.ti proriiicc»d 
sii^nif icfini: i nnrea*?*?;* only In thp rcacllnri total f^cnn? far 
»lud£!?r»ts a-f teacht-r "S". 



Table 145 Standardised Test Results: 



Social Studies 



Teacher 



pretest 
posttest 



Mean: 



5.2 



5. 



St. Dev. 
1.2 

2. O 



(t = 0. 10; df ^ 35; 

two-tailed critical value +or p 



.05 = 2 . 03 > 



Teacher 



pretest 
posttest 



8.3 
8.2 



(t - 0.24; df 28; 

two-tailed critical value -for p < 



05 = 2.05) 



3 c: i ence 

Tpsts revealed that the science po^>tte5t scores (reported it) 
qrado equivalents) of students in the classes of Teacher "I" were 
not significantly different from their pretest scores (see Table 
X?'>) . Posttest and pretest scares from the students in tiie 
cl£isses of Teacher "S** were not available. 

Table 15s Standardised Test Results: 

Sci ence 



Teacher "I*^ 



pretest 
posttest 



Means 
5.0 



cr c 



St. Dev. : 
1.9 



■<t = 1.24; df = 33; 

two-tailed critical value -for p 



.05 



:. 04) 
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student Sat is-f action 

Forty-nine student satisfaction questionnaires were returned 
from the students in the classes o-f teacher "I"; Thirty-four were 
returned -from the students in the classes o-f teacher "S". The 
ratings provided by each student were averaged to produce a mean 
satisfaction score. Satisfaction wa«3 defined as a mean score of 
greater than 3.0 on the five-point Likert-type scale. Forty-four 
<90 percent) of the 49 mean scores computed for the students in 
the classes of teacher "I" indicated satisfaction with the 
computer-based program. Eight (24 percent) of the 34 mean scores 
computed for the? students in the classes of teacher "B" indi edited 
satisf act i on. 

Teacher Satisfaction 

The Teacher Satisfaction Questionnaire asked the field test 
teachers to rt'??pond to a number of open-elided questions 
concerning difficulties encountered, appropriateness of content, 
instructional value nf the product, and suggested instructional 
app 1 i cat 1 ons . 

Both teachers experienced minor technical difficulties with 
the equipment. Teacher "1" reported that she had difficulty 
starting the program on two occasions. Teacher "S" found it 
difficult at first to use the Macintosh computer because she had 
not used it before. However, sht- stated "Once I became more 
comfortable with the MAC it was not a problem." She found that 
students using the computer to "make up lessons" were able to 
utilize the program with very little assistance. 




Teacher " r* reported the content o-f the tutorials to be? 
"very" appropriate. Haivever, she found the reading level to be 
slightly advanced for 6th-grade at-^risk students, and frequently 
paraphrased for them* She indicated that students liked the 
program, and stated, '*MnBt students reported that they lc?arned 
new skills and used them occasionally in content classes-*' 

Teacher "S" pointed out that the tutorial examples replied 
heavily on science reading examples, whereas sho was using the 
computers-based program to teach strategy u^b in a social studies; 
class. She stated, I experienced a lot of difficulty with 
students:^ over- the cnntc^nt used to instruct the strategies. Many 
students didn't like taking so much time out of their content 
area to learn study sti-ategiei; primarily tauqht through anothc;?^ 
subject iftattr^^r. The tutorials would havc^ been mi.ich more 
cuccessful if they had b£?en mure iJirFctly related to the rla^.ts 
sub J ect mat t er . " 

Teacher indicated the- reading If-vcl was appropriate for 

the classes she taught. However , ^.he stated, "readability was 
complicated because many of the students were unfamiliar v-jith the 
content vocabulary and tber really wasn't enough titne to develop 
background knowledge that would have added reading 
comprehenssi on - " 

When asked how the tutorials were helpful, teacher 
responded, '*they saved time because I wasn't required to put 
examples on the board; I could return to review concepts that 
were nuL firm. Tlie pruyr am gavie me a consistent q^tide fur 
presenting information across my classes.'* 
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Teacher "S" stated, ''The tutorials were great -far 
introducing the strategies but did not provide enough di-f-ferent 
instructional opportunities to teach to mastery. I felt very 
rushed in the timelines set up and feel this hurt the 
effectiveness of the tutorials. I needed more class practice 
activities and instructional time prior to taking the qui.^ or 
having the student take the second passage e>iam. " 

Teacher "I" concluded thai the product was useful because it 
provided ready made training materials for the instruction of 
study skills. Tu^acher "S" said, ^'Ihi^ type of tutorial would be 
excellent in an Englir^h curricuTuni that was directed towards 
Btudy strategies, in a remedi..a rerridinq program at the secondary 
level, in an elementary curriculum or resource room proqram. Tho 
ti4toriais are very teacher H i.endly and would be an <.^)u:el 1 c-^nt way 
fur a tpachci-r wfio in nol: familiar uith the ntrateqies tc^ instruct 
tliem. Having everything p>-epared m..ikeiH> tliem easy to utn t;^e in 
the classroom. '* 

CGNCLIJSIDNB AND IMPLICAI inNS 
Conclusi ons 

The revised training program was largely successful in 
meeting the student learning objectives established for it. 
"HyperCard" computer -presented instruction alone produced 
significant increases in strategy application scores in two of 
three strategies for each tEracher. The expert system-abased 
discussion guides produced significant i ncrease^i-i in five of six 
measures of metacogni t i ve strategy knowledge. However, with one 
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exception, the? program did not produce signi-ficant increases in 
standardised test scores. 

Applications oi computer technology in the revised product 
could be considered success-ful in addressing many o-f the teacher- 
related difficulties that have been identified as restricting the 
iinplementatian of strategy instruction programs in the past. The 
product provided a vehicle for teachers to learn study and 
metacpgni t i ve ^strategies as they initially presented strategies 
to stud£?nts. It also reduced a demand on teachers' time required 
for the initial preparation of structured presentations by 
supplying necessary exaniples and guides for instruction. 

In the prototype program, students had been asked to 
indopend€?nt 1 y use a computer to learn study strategy procedurr.-s. 
Howover , the learning environment created in indi vi dual i .iod 
coniput er - bav:ed 1 ear fi i ng programs can be artificial , ar^ Hat i va 
(1988) found, and may actually introduce new learning problems 
for lots- achi evi ng «iturients. Students may have difficulty 
"adapting" to the environment. 

Un the other hand, participation in group problem-solving 
may assist luw~ach loving students to learn in a number of ways. 
Btudc-nts are interacting with actual class'^oom materials, and can 
follow along more easily because they can see how the teacher and 
stronger students apply strategy skills. This use of the group 
process is supporte<j by previous work:. Two good examples are 
Palinscar and E-irowns ' (19B4) F:eciprocal Instruction and Webb's 
(19W2) Cooperative Learning. riie ttairriny product wa.-^ revised to 
utilii^e the resources available in a group problem-solving 
envi ronment . 
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Broup problem-solving allows the evaluation o-f "constructed" 
student responses by appropriate? evaluation sources — the teacher 
and other students. Computer technology presently cannot 
evaluate the types of responses that students need to make to 
demonstrate they can apply study and metacogni t i ve strategies. 
It can, however, prompt group discussions o-f strategy 
applications at appropriate times. In the revised training 
product, the co(nputt?r was no longer used to evaluate student 
rc?i-.ponst-?f; , but wan used to enhance the group's role in evaluation 
by pr ompt ifitj discussions. 

Impl i cati nns 

l-oth main field test teactier s -iugqested the revised training 
^.rf.tu .^nj war^ <in "excel 1 tvrl " way to introduce- st.udy strategiet> to 
studt'iil'i -snd would tat? uscruJ to nc?w teachor ?3 . Tliey r ecomonc-nded 
the- |..r uqr am l.u^ uried for initicU r.tr ategy i ncr-tr uc t i on , ^:itndent 
revic-w, and bringing incoming students "up co vspeed" with the 
rest of the class. It is likely that using the prog, am reduces 
?:iome teactier- training demands bocause of the structure it 
provides for instruction. 

It should be noted that the teacher more experienceri in 
group-based instruction of study strategies, teacher "S" , 
emphasised the need to provide substantial amounts of practice in 
applying study strategies to classroom materials. This teacher 
stated that the -felt constrained by the artificial timelines 
established for thiv rest?arch study. 
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In addition, teacher **B*' empha«^x2Gd the net-^ci ta niakc^ the? 
contf^nt material used tor stratuqy instruction relevant to the 
clashes in which the progr am is boang nsr^d- Ft^w o+ the ^^tudpntr^ 
in the classes of tec^i:her "S'* s^xpres^ed satis+action with th^ 
trvixninq proQr am becausp, ic\:u.her "S" e^^pl cvi ned , hpr students 

di(inM, like learning strateqit?r> in a subject matter* unrt?latDd to 
the class tht?y wort? in Af.> i pachnr **S'* tdtated, " Vhe^ students tiad 
i| i f f i r: itl ty $->Bi?inq beyond thi? <irivvr7C<.) con! •:nt to r^v-^l :i tliti» 
' proce\^*f^ ' wa:> tliK* r c-^al {"c^ntc i'd „ 

In r evi ewi ncj the re'^-'i.il t (jf M'u? pr^:?sc-Hrt study, tho 
developc'r-ii cor\Bidi?red tlip oosv 3 h 3 1 i t v or developi nq a "content- 
f* i:.'e" t:c.jnpt.itt^r'-'I/a^^tM:l she:;! 1 ^aj (vu.dC:? tjl -^r^;! on iJnrinq .tLnrly 
-^.Irati^My i nv^^tr uc i i on. ctuuvi;. ,^xc.\) <\ sht^n <:oiiJd nut providr: 

u;.; aj;<pl i^f coritt-Md: sj^.ppl j )n - 

f ht' jircnhu i dove 1 Oj.>»:'i 1 m ..^- ( : i'\.m h i c; (J U:» IjO mc-cinv hy 
-^lufh tev:u:hi'»r'^i conld sy^.a r:)r dn . 1 1 ly mili.^tr^ :i i issl ru(- t .1 >jn 3n 
Hv^vt r.i3 J mporLani ^l:udy .;>t r aliv-w i i „ It a^^iMrt^:: initial 
i ni>l rnr: ti on becaMiio it prcjvldr'r- t:-.! .HHip) » e^'^ -iifd a riu;irii:? -for qra^ip-- 
t: y c \ 5 C' d d i r*> c 5-:; < > i c: > n . 

In futurp i mpl f?int?;nta I i t:«nv: of the? prodiirt, thr^ devcl oper r- 
uould J.u'qc> users to ansiir;? tfio t:.orit.f:nt eKamplt?.:^ u^ivmJ in the 
prnrjrani wcrtv relc^v^ant to I he? coi/hcrd: boinq tauqht ir^ the ria*-st:> in 
which the f:rnqrvHm iB tu bo used. Tlie dovrUopors would al^uo 
eotpha^^ire the? nBcnJ ror Le-Zichrr- s \:a (:u cr/?dp additic^nal strai.i'^cjy 
ap J, ir.ation practice boyond that pjrof/)pted in th^? contput c^r -ba«5Fd 
pr ocjr am. 
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Appendix A 
Sample Prototype Comprehension 



Name:; 

SUMMARIZING PRE/POSTTEST 



1. Find the best words to complete the following statement: 

When we summarize, we read for the purpose of finding the 

most important information in a reading passage, and 

that information into a brief paragraph, or summary. 

1) compare 

2) condense 



2. What are key points? (Two of the following are correct) 

A) statements of details. 

B) statements of the most important information. 

C) statements of facts. 

D) statements that can be used to form a summary. 



3. Why do we skim a passage before summarizing? 

A) Because it helps us to locate facts contained in the 
reading passage. 

B) Because it helps us to locate details contained in the 
reading passage. 

C) Because it helps us to locate information contained in 
the reading passage. 

D) Because it helps us to locate the most important 
information contained in the reading passage. 



4. Which of the following words best completes the sentence: 

can give us a good idea of what the author 

thinks is most important. 

Reading slowly 
Self-study questions 



5. Find the word that best completes the following sentence: 

If you think that the first sentence in the paragraph 
contains the key point, look at the other sentences in the 
paragraph as well. If the first sentence contained a key point, 

it will usually be by the other sentences which will 

give details about the key point. 



supported 
replaced 
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6. Find the best word to complete the following sentences: 



When we make up a list of key 
sometiwer. the list contains points 
key points. They are likely to bte 
key points. 

support 
are 



points from a reading passage, 
that should not be considered 
facts, or details that 



7. Read the following paragraph and underline the sentence that 
contains a key point: 

The interview method is used to see what an individual's 
personality is like. A rating scale is also used to judge 
personalities. A personality inventory or quest ionaire also 
gives information about people and the way they act toward 
others. Personality can be measured in several different ways. 



8. The following is a key point from the reading passage. 

"Forecasting weather is a very helpful service" - 

With which of the following key points may this point be 
combined? 

A) A weather expert can usually tell what weather conditions 
will follow in the next day or two. 

B) Weather warnings often save crops. 

C) Weather warnings may even save lives. 

D) Thousands of people plan their trips and even their daily 
clothing according to the reports of the weather experts. 

E) Forecasting the weather is one of the services the United 
States government provides for its citizens. 



9. Read the following paragraph, and create a key point 
statement : 

Passage title: "Muscles" 

All body movement from blinking an eyelid to kicking a ball 
requires the use of muscles. Digestion, circulation of blood, 
and excretion of wastes also depend on the action of muscles. 
Muscle is tissue that moves the parts of your body. The more 
than 400 muscles of the human body make up about a third of a 
person's body weight. 

Self-study question: How do muscles help you to live? 
Your key point: 



ERIC 



2 



Appendix B 
Sample of Instructional Script 



Skimming Lesson 1 G 




8/29/89 1 




Because yoa have 
so nuHrh to read, 
you need a way of 
covering reading 
material FAST. 




Stratejnr WhsluS 



Skimming helps 
yoii cover your 
reading material 
FASTERi 





Skimming Lesson 1 G 



8/29/89 




I 



Skimming helps 
you quickly find 
ANSWERS to 
QUESTIONS. 




91 




On the Lesson 1 
W<»ksbeeu look ai 
the "Steps for 
Skunming.'* This ia 
aUsiof s^I» you 
follow when you 
skim. 
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The Cmi siep of the 
Skimming S&ategy is: 

\) Read QUESTIONS 
fof the maierial. 



BEST COPY AVMUILE 



Skimming Lesson 1 G 



8/29/89 



3 



V/hil is Skia 



QUESnOK'S 
"Deierti.'' 




As a class read the 
QUESTIONS. 
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Draw a line undc^ what you rend. 





Skimming Lesson 1 G 



8/'29/89 







On ihf Le$5on ) 

check the boj^ to 
show you have 
done Siep 2* 





M SSQjnPttAgSirBtigr WhatrtSlummin 



Draw a line under whai you read. 




Skimming Lesson 1 G 8/29/89 5 







BESmorVWMUILE 



Skimming Lesson 1 G 8/29/89 6 




Quit 




Now. yoa wiil check your answer to 
Qoessioii 2 with a group disease ioo. 
Begui discussion with these qucsuons; 

1) What b jrour ANSWER for this 
question? 

2) How tmuy STFPS did you have lo do to 
find 

Chal answer? 



As a class, read QIJESTION 3. 



Oil— ii<liiwi?Wfl«f twit ag» X^Himvwmamatm 



Look, in ibe pans of the passage you and 
underlined to find an ANSWER to QUESTION 3, 





jStnti^ UfUUfKS Y WORDS to AngygrOviK^Qm TUfllB 
AMEBaBNOniMraHHMHHlia 

Now, you Will check your answer lo 
Question 3 n-ith a group discussion, 
Begii discussion mih these questions: 

V What is -our ANSWER for this 
quest ioi^? 

2) How many STEPS did you have to do to 
find 

?hal iiA'^^^r? 
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Skimming Lesson 1 G 





Uaag KEY WORDS tPAa»v«rCMKrtt» i 



Now. yoa will check year answer ti> 
Qae^um 4 with a gioup di$cus»oD. 
Regiii dificttssifm with these questims: 

1) WhfiS Is your ANSWER for this 
qttTSfioa? 

2} Hor snany STEPS did you have to do to 
tied 

that answer? 



8/29/89 



You answo' as many QUESTIONS as you 
con now, because you have read the MOST 
IMPORTANT INFORMATION in the 
pamge. Yoo can im>babiy ANSWER 
MOST of the QUESTIONS, 





I SMngni' 



On ihe Lesson 1 
Worksheet, 
check the box to 
show you have 
done Step 4. 





Authors give you 
QUESTIONS lo 
help you find the 
MOST 

IMPORTANT 
INFORMATION. 
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By answering 
theauihor's 
QUESTIONS. 
you fad the 
MOST 

IMPORTANT 
INFORMATION 
in the reading 





Croup pKCu^ion S; 




Why do authors give yoa QUESTIONS? 



7 ' 



Skimming Lesson 1 G 



8/29/89 



8 





A good answer is: 

Aoihon ghfe yw QUESTIONS 
ito he^ yoo fiml IMPC^TANT 
INFC»IMATIC»I. 




i 



Look at die passage 
"Desens*" Yraicad 
ONLY the pans thai 
are underliiied, Ychi 
DID NOT have to 
read the whole 
IMsage* 




Because you DID 
NOT have to lead 
the whole passage* 
you covered the 
material FASTER. 





??VirrrtTnivgf Strategy UciMfihiStaflggiayStrfltfliiy 




How can skimming help you? 
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BEST COPY AVmillll 



Skimming Lesson 1 G 8/29/89 



Skimming Strategy: Quit 

Click <mi2»l>utton of ^QurcbofOt. Htw mad t^juoo opemion 
[ Carrol j {UtmiothifBmeisicrBvii 
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Appendix C 
Sample Lesson Worksheet 



Steps for Skimming 

Skimming involves reading through material rapidly to locate information. 

Step 1: Read questions for the material. 

Step 2: Read introduction and summary. 

Step 3: Read first and last sentences of all other paragraphs. 

Step 4: Answer questions for the material. 

Step 5: Locate key words for unanswered questions. 

Step 6: Reread sentences or paragraphs containing key words. 

Step 7; Answer remaining questions. 
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Deserts 



Introduction 

The deserts of North America are home to many differents kinds of life. 
The living conditions found in the desert are very harsh. The plants and 
animals that live in the deserts are adapted to live with the difficult 
conditions found in the deserts. 

The Deserts of North America 

The deserts of North America are located in the southw^estem part of the 
United States. The are in the Great Basin, between the eastern and western 
ranges of the Rocky Mountains. 

There are two types of deserts: the cold desert and the hot desert. The 
northern desert is the cold one, the southern desert is the hot one. In the 
suminer months both deserts are hot. But, the northem desert is colder in 
the winter months. An important thing to remember about a desert is that 
the temperatire changes durong a 24-hour period. Temperatures, during a 
summer day, are above 100 degrees. At night, the temperature can drop to 
near freezing. 

Winds blow often and with great force across deserts. Sand, which 
makes up much of the desert soU, is blown into hills of sand called dunes. 
Many beautiful rock formations are carved out of the stone by the sandpaper 
action of windblown sand. 

You may be surprised to find that deserts are not caused by high 
temperatures, but by a lack of water. Very little rain falls m the desert. 
Less than 10 inches of rain falls on the desert each year. And that amount 
can fall all at one time. When rain falls, the land caimot soak up much of the 
water. Also, there are not enough decayed plant materials or plants to 
absorb die rain. Since die air is hot, much of the water evaporates before 
plants and animals can use it. Most of the remaining water runs off. Only 
the top of the ground gets wet. 

Plant and Animal Adaptations to the Desert 

Living things can survive in such a dry environment by conserving all 
the available water. Many desert plants complete their whole life cycle in 
the very short time that water is available. They grow from seeds and 
produce flowers. Then they produce seeds and die. These seeds can 
withstand very high, or very low temperatures. They will not begin to grow 
until the right conditions return. 



o 
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Name: 
Date: 
Teacher: 
Period: 

Worksheet 1 

Steps I followed for the reading passage "Deserts." 



Done 








□ 


Step 


1: 


Read questions for the material. 


□ 


Step 


2: 


Read introduction and summary. 


□ 


Step 


3: 


Read first and last sentences of all other paragraphs. 


□ 


Step 


4: 


Answer questions for the material. 


□ 


Step 


5: 


Locate key words for unanswered questions. 


□ 


Step 


6: 


Reread sentences or paragraphs containing key words. 


□ 


Step 


7: 


Answer remaining questions. 



Answers to questions for the reading passage "Deserts." 
1.^ 

2 

3 

4 
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Appendix D 
Sample Lesson Content Quiz 
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Name: 
Date: 
Teacher 
Period: 



Lesson 1 Quiz 



1. Why do authors give you questions? 



2. How can skimming help you? 



Start time: Name: 

Date: 

Finish time: Teacher: 

Period: 

Skimming Posttest 

1. How can skimming help you? 



2. Why do authors give you questions? 



3. Why can you answer most questions with the first four steps of the 
skimming strategy? 



4. How are key words used in the skimming strategy? 



5. Why do authors highlight words? 
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Appendix E 
Sample Strategy Application Test 
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Start Time: Teacher 

Period: . 

Finish Time: Date: 

Weather 

The Atmosphere 

Earth is surrounded by a blanket of gases about 900 
^ km thick. This is Earth's atmosphere. The atmosphere /£) 
helps to hold in Earth's heaL In addition, it protects^ 
Earth's surface from harmful rays of the sun. The 
atmosphere is difficult to detect on a clear day. You don't 
sense its presence unless the wind is blowing. 

The gases of the atmosphere push down on Earth's 
surface wi»h great force. Force applied on a given area of 
surface is called pressure. The force exerted by the 
atmosphere on a given area of Earth's surface is called 
atmospheric pressure, or air pressure. Atmospheric 
pressure at Earth's surface is sometimes referred to as 
one atmosphere of pressure. 

You notice differences in air pressure when it 
changes rapidly. Think of what happens when you are on 
a fast-moving elevator. The plugged-up feelmg in your 
ears is caused by a change in air pressure. Air pressure 
decreases as height above Earth's surface increases. The 
low pressure at high altitudes makes it necessary for 
airplanes to have pressurized cabins. 

Atmospheric pressure is measured with n 
instrument called a barometer. In the 1600's, Otto von 
Guericke made a giant barometer to demonstrate air 
pressure. He attached a 10-m pipe ahnost full of water to 
the side of his house. The bottom of the pipe was in a mb 
of water. When air pressure increased on the wL^r in the 
nib. the water rose in the pipe. When the pressure 
decreased, the level in the pipe dropped. Von Guericke 
tried to predict weather as the water-level rose and fell. 

Scientists have found that the atmosphere consists of 
several layers. The layers differ in such physical 
properties as pressure and types of gases. The most 
significant characteristic of each layer, however, is its 
pattern of temperatures. 
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The layer of the atmosphere closest to Earth is called 
the tropo:>phere. It contains about 90% of the total mass 
of the atmosphere. The troposphere is about 16 km thick 
at the equator. It thins toward the poles. The temperature 
of the troposphere is highest at Earth's surface. It 
decreases gradually with height The lowest temperature 
in the tn^osphere is found at its upper boundary-the 
tropopause, ^ 

Almost all of Earth's weather occurs in the /(/ 



troposphere. For this reason, it is the part of the ^ 
atmosphere that has the most noticeable effect on our 
daily fives. 

The layer above the troposphere is called the 
stratosphere. The stratosphere begins about 16 km above 
the Earth's surface. It is about 32 km thick. In this layer 
there is a steady increase in temperature due to the 
absorption of hi^-energy ultraviolet rays from the sun. 
(Ultraviolet rays are mvisible rays with higher energy 
than visible light.) You may have heard of the ozone 
layer. This Is the part of the stratosphere where 
absorption of ultraviolet rays occurs. The ozone layer is 
a broad band of gas that extends through most of the 
stratosphere. A molecule of oxygen is made up of two 
atoms of oxygen. When oxygen molecules are hit by 
ultraviolet rays, they break apart into separate oxygen 
atoms. Some of these atoms then combine with other 
oxygen molecules, fomiing ozone, which has three atoms 
of oxygen. 

Scientists worry that the ozone layer can be 
destroyed by some of the gases used in spray cans. Some 
of these gases react with ozone. This reduces the amount 
of ozone in the ozone layer, allowing more ultraviolet ^ 
rays to reach Earth's surface. Ultraviolet rays can ^^^'3) 
harmful to living things. For example, people who are 
exposed to large amounts of ultraviolet rays are more 
likely to get skin cancer. This is one reason people are 
cautioned to limit exposure to the sun, or to use special 
lotions that block out ultraviolet rays. 

The upper boundary of the stratosphere is called tfie 
stratopause. Beyond this the temperature decreases again. 
The layer above the stratosphere is called the mesosphere. 
In the mesosphere the temperature decreases to -100 
degrees C. The thermosphere lies above the mesosphere. 
Here the temperamre increases to several thousand 
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degrees. Ultraviolet rays from the sun bombard the gases 
in the thermospfaere. This ionijECS (charges) them. These 
ionized gases form a layer within the themiosphere called 
the ionosphere. The ionosphere has electrical properties, 
and because of diese, the ionosphere is used to relay radio 
communications around the world. Radio waves can be 
reflected off parts of the ionosphere. This allows them to 
travel farther around Earth. 

The outermost part of Eartli's atmosphere extends 
from about 480 km out to 960 km. This part is called the 
exosphere. There is no real boundary between the 
exosphere and outer spacer. The gas particles just get 
farther and farther apart. Some may be kilometers apart. 

The composition of the atmosphere varies. The two 
lower levels (the troposphere and stratosphere) contiun 
the mbtmre of gases that we call air. The most abundant 
gases in air (by volume) are nitrogen (78%), oxygen 
(21%). iigon (0.9%). and carbon dioxide (.03%). there 
are a number of other gases, including water vapor, in 
air. rhese gases, however, make up less than 0.1% of the 
air. 

Air contains many solid particles also. Dust-sized 
bits of matter from industry and volcanic eruptions are 
examples. In addition, the ocean adds salt particles to the 
air as water evaporates from ocean spray. Substances that 
enter the atmosphere may travel far from their sources. 
They may eventually affect the weather. 

Wind 

Wind is air in motion. You have probably observed 
how changeable wind can be. Sometimes there is hardly 
any wind. At other times, it is difficult to rauve against it 
Wind is something you can't see, but you can see its' 
work. 

The major cause of wind is the unequal heating of ( 
Earth. Energy from the svn is not received equally ail 
over Earth's surface. The greatest amount of energy is 
received where the ".uii's rays striking the surface are 
vertical, that is, at right angles to the surface. A vertical 
ray delivers more energy per square meter of surface 
than does a slanting ray. As a result, areas receiving 
vertical rays are warmer. Because Earth's surface is 



curved, some places receive vertical rays while other 
places receive slanting rays. 

Other factors also affect how much of the sun's 
energy is received by Earth. As the sun's energy nears 
Earth, it is affected by the atmosphere. Some energy is 
reflected back by clouds. Some is absorbed in the 
stratosphere or by water vapor in the troposphere. And 
some is scattered by dust particles in the air. A little less 
than half of the sun*s energy that reaches the atmosphere 
arrives at Earth's surface. 

Some heat is added to the atmosphere by the ground. 
Energy from the sun comes to the surface of Earth in 
short, high-energy waves. These are absorbed by the 
ground. Earth, in turn, radiates long, low-energy waves 
back to the atmosphere. In this way, the ground adds a 
small amount of energy to the atmosphere. The long- 
wave energy radiated by Earth is absorbed by carbon 
dioxide in the atmosphere. The "trapped" energy causes 
the atmosphere to become warmer. This is called the 
greenhouse effect, because greenhouses work on the same 
principle. The greenhouse effect keeps Earth, warmer 
than it would without an atmosphere. 

As a result of unequal heating, air is warmer in some 
places than in others. Warm air expands, becomes less 
dense, and rises. Cooler air then flows in to replace the 
warm air. The result is wind. The wamier air cools as it 
rises, becomes denser, and sinks agaiiL This motion of air 
is called a convection current or cell. The principle of 
convection is used in some heating systems in homes. 

A common example of local air convection cell 
occurs along the seashore. Land heats up faster in the 
daytime than water does. During the day, warmer air 
over the land rises and flows toward the water. Cooler 
air from over the water flows in to replace the warm air. 
The result is a cool onshore breeze, or sea breeze. At 
night, the reverse takes place. Land cools more rapidly 
than water. The warmer air over the water rises arid 
moves toward the land. Cooler air from the land flows in 
to replace the warm air. The result is an offshore breeze, 
or land breeze. 



Wind Patterns 



If Earth were not rotating, air heated at the equator 
would rise, spread toward each pole, and sink as it cooled. 
Cool air would then move along the surface toward the 
equator. The winds at the surface would always be from 
the north or south. However, Earth's rapid rotation 
from west to east affects air currents. Earth's rotation 
causes air to be deflected in a clockwise direction in the 
Northern Hemisphere and in a counter-clockwise 
direction in the Southern Hemisphere. This change in the 
path of movement caused by Earth's rotation is called the 
Coriolis e^ect. 

In the region between 30 degrees N and 30 degrees S 
the surface winds are mostly from the east. These arc the 
trade winds, or tropical easterlies. Between 30 degrees N 
and 60 degrees N and 30 degrees S and 60 degrees S, the 
surface winds arc from the west, the so-called prevai/iVig 
westerlies. Finally, between 60 degrees N and 90 degrees 
N and 60 degrees S and 90 degrees S, the winds are from 
the east - polar easterlies. This is the global pattern of 
winds on Earth. Notice that winds are named according 
to the direction from which they blow. ^ 

Warm air rises because it is less dense than cool air. 
Cooler air, being more dense, exerts a higher pressure 
than warm air. Thus, when cool air flows in to replace 
rising warm air, the air flow is from a region of higher 
pressure to a region of lower pressure. Regions of high 
and low pressure, caused by unequal heating of the 
amiosphert, determine which way the wmd will blow. 

Wind blowing outward from a hig)-* pressure area in 
the Northern Hemisphere is deflected by the Earth's 
rotation. The wind moves clockwise. Wind blowing 
inward around a low pressure area in the Northern 
Hemisphere is deflected in a counterclockwise direction. 
(In the Southern Hemisphere, these directions are 
reversed.) The greater the difference in pressure and the 
closer these systems are together, the faster the winds will 
blow. 

High above Earth's surface are upper-level windy^ 
called jet streams. These are about 10 km above Earth'f- 
surface in the middle latinides. The jet streams arc caused 
by extreme differences in pressure at this level of the 
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atmosphere. The major jet streams in the Northern 
Hemisphere blow from west to east. 

High level winds in the atmosphere are not slowed 
do'im by contact with Earth's surface. The air is less 
dense at this altitude, so winds can reach very high speeds- 
as great as 40O to 500 km/h. 

By observing the -^ath of a jet stream, meteorologists 
(scientists who study u. J weather) can predict the paths of 
highs and lows on the surface. High pressure areas, or 
highs, on the ground are usually under highs at upper 
levels. Low pressure areas, or lows, on the ground are 
under lows in a jet stream. Pressure systems on Earth's 
surface behave like shadows of the jet streams above 
them. 



Clouds form when warm, moist air rises. As it rises, 
the warm air expands and cools. As air cools it loses its 
ability to hold water vapor. As warm, moist air rises and 
cools, it reaches a temperature called the dew point. At 
this point the water vapor it is holding starts to condense, 
or change to liquid water. Water condenses on a solid 
surface. (You may have seen this happen on the outside of 
a glass of cold water.) Water in the atmosphere condenses 
on dust of salt particles. These are called condensation 
nuclei. Qouds are made of billions of water droplets that 
have condensed out of the air. 

There are many different kinds of clouds, but they 
are classified into three main types. Stratus clouds are (j( 
layered clouds that usually cover the whole sky. Cumulus 
clouds are billowy clouds that look like huge heaps of 
cotton. Cirrus clouds are high, thin, wispy clouds. 

Once you know the three main cloud types, a few 
other ternis are all you need to help you name clouds. For 
example, nimbus, which is Latin for "rain," can be added ^ 
to cloud names. Cumulonimbus clouds, also called (T? 
thunderheads, are huge, towering clouds that fonn when 
a cumulus cloud expands into a vertical rain cloud. 
Cumulonimbus clouds bring winds, lighming, showers, 
and sometimes hail. Nimbostratus clouds are sheedike 
clouds that usually bring rain. The prefix alto is often 
used to identify clouds of intermediate height. Altostratus 



Clouds and 




and altocumulus are "middle-level" clouds. The tenn is 
used to describe stratus clouds at ground level is/<?^. 

Qoud droplets are very tiny. It takes a million cloud 
droplets to make one raindrop! When enough cloud 
droplets accumulate, a drop becomes heavy enough to fall 
as precipitation. 

The kind of precipitation that falls depends on four 
major factors: the type of cloud from which it falls, tl^ 
temperature of the cloud, the temperature of the air 
through which it falls, and the temperature of the 
ground. 

Rain is probably the most common form ot 
precipitation. It can fall from any cumulonimbus or 
nimbostrams cloud. Sleet is rain that has fallen dirough a^ 
cold layer of air and is frozen by the time it hits the \ 
ground. Sleet usually originates in high stratus clouds. | 
Driizle M ^^"^ nf vpnr tmv d mns of water . T hes * 
sometimes stay suspended in the air as a tmst. Drizzle 
v^iA^Wns in low4ying strams clouds. If &e te mperature-et 
the gfound is lilow freezing, the drizzle treezes as it hits j 
the ground. ^ 

If the clouds are high and cold enough, the water 
freezes in the cloud and starts out as snow. If it melts on 
the way down, it lands as rain. If the temperatures are 
low enough all the way down, the precipitation remains 
snow. ^ 

Hail is another form of frozen precipitation. It Aq^ 
usually accompanies thunderstorms and comes from ^ 
cumulonimbus clouds. If the clouds are piled up 
extremely high, the winds inside the cloud form strong 
convection cells. In these cells, raindrops are lifted to 
heights where it is so cold they freeze mto hailstones. 
Hailstones can be tossed up and down within the cloud 
many times. They pick up layers of ice as they move. 
When Lhey get heavy enough, they fall. The largest 
recorded hailstone was 19 cm in diameter, about the size 
of a volleyball. A hailstorm can do a tremendous amount 
of damage in a few minutes. Hailstorms often flatten 
growing crops such as grain. 

The amount of precipitation varies around the worid. 
Some places, such as the Atacama Desert in Chile, have 
n<sver recorded any rainfall. In contrast. Ml Waialeale in 
Hawaii receives about 1200 cm each year! 
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Questions 



-^T What is the atmosphere? 
"2: Name two ways the atmosphere effects Earth? 
^. What is atmospheric pressure? 
<, In what layer of the atmosphere does weather occur? 
^. How could a change in the ozone layer affect life on 
Earth? 

>r What is the most abundant gas in the air? 

What is the major cause of wind? 
^. About how much of the sun's energy that reaches 

Earth's atmosphere actually arrives at Earth's surface? 
J^, What does the greenhouse effect do to the temperature 

of Earth? 

A^. Describe the cause of a Seabreeze. 

-H. What is the name for the change in the path of 

movement of air caused by Earth's rotation? 

How are winds named? 
43. What are jet streams? 

44c How does knowing the path of a jet stream help 

weather prediction? 

What causes a cloud to fomi? 
4:5. What are the three main types of clouds? 
-YT. What is another name for a cumulonimbus cloud? 
48*. What is the difference between sleet and snow? 

What kind of cloud produces hail? 
~2e. What kind of cloud produces drizzle? 



Name: 

Teacher: 

Period: 

Date: 

Answer Sheet for Weather 



1. 



2. 



3. 



4- — 

k- 



5. 



6. 



7. 



8. 



9. 



10 * • * 
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11. 

12. 
13. 
14. 
15. 
16. 
17. 
18. 
19. 
20. 
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Skimming Answers: Weather 

1 . What is the atmosphere? 

A blanket of gases around Earth. 

2. Name two ways the atmosphere effects Earth? 
Holds in heat. 

Protect's Earth's surface from harmful rays. 

3. What is atmospheric pressure? 

The force exerted by the atmosphere on a given area of Earth's surface, 

4. In what layer of the atmosphere does weather occur? 
In the troposphere. 

5. How could a change in the ozone layer affect life on Earth? 
Any one of the following: 

1. By allowing more ultraviolet light to reach Earth's surface. 

2. ultraviolet light can be hamiful to living things. 

3. Can cause skin cancer. 

6. What is the most abundant gas in the air? 
Nitrogen. 

7. What is the major cause of wind? 
Unequal heating of Earth's surface. 

8. About how much of the sun's energy that reaches Earth's 
atmosphere actually arrives at Earth's surface? 

A little less than half. 
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9. What does the greenhouse effect do to the temperature of 
Earth? 

Keeps Earth warmer. 

10. Describe the cause of a Seabreeze. 

Primary answer: Land heats up faster than water. 

OK if further explanation included: Air rises over the land and goes 
toward the water. Cooler air flows in from over the water to replace the 
warm air. 

11. What is the name for the change in the path of movement of 
air caused by Earth's rotation? 

Coriolis effect. 

12. How are winds named? 

According to the direction from which they blow. 

13. What are jet streams? 
Upper level winds. 

14. How does knowing the path of a jet stream help weather 
prediction? 

By Knowing the path of the jet stream, scientists can predict the paths of 
highs and lows on the surface. 

15. What causes a cloud to form? 
Clouds form when warm, moist air rises. 

16. What are the three main types of clouds? 
Stratus, cumulus, cirrus. 

17. What is another name for a cumulonimbus cloud? 
Thunderheads. 



18. What is the di^erence between sleet and snow? 

Sleet is rain that has fallen through a cold layer of air and is frozen by the 
time it hits the ground. Snow happens when water freezes in the clouds. 
Also: Snow starts in the clouds. 

19. What kind of cloud produces hail? 
Cumulonimbus. 

20. What kind of cloud produces drizzle? 
Drizzle comes from low-lying stratus clouds. 
Comes from stratus clouds. 

Comes from low-lying clouds. 
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Appendix F 
Sample Test of Metacognitive Knowledge 
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Teacher 



Period: 



Preparing for Instruction: Pretest Posttest 

Study the following examples, and try to determine if each 
student has done everything he or she should have to properly 
prepare for instruction. 

If a student has done everything he or she should have, 
circle the word "complete". If a student has not done everything 
he or she should have to prepare, or has done something 
incorrectly, circle the numbers of the activities which he or she 
has missed or has done incorrectly. 

The four activities that should be done to prepare for class 
are: 

1. Find out what material will be covered in class by looking 
at a class assignment calendar or schedule or by asking 
the teacher. 

2. Skim to answer the questions. 

3. List the key points. 

4. Make up a list of questions for any material that seems 
unclear. 

Example 

********************************************** 

This is how Jeff prepared for class the next day: 

Jeff looked on his class assignment calendar to determine 
what materials to study. After skimming the materials, Jeff 
answered many of the questions. He then listed the key points he 
found in the materials. Jeff didn't have time to list his 
questions about the material. 

What is missing? 12 3 4 complete 

********************************************** 

Exercises 

********************************************** 
1. This is how Ann prepared for class the next day: 

Ann ask the teacher what materials to prepare for the next 
day. After skimming the materials, Ann answered many of the 
questions- Using the things she'd practiced when she learned how 
to summarize, Ann listed the key points of the material. She 
carefully listed a question about every part of the material she 
didn't understand. 

What is missing? 1 2 3 4 complete 

********************************************** 



********************************************** 
2. This is how Ann prepared for class the next day: 

Ann wasn't sure what materials to prepare, so Ann looked at 
the class schedule. Ann used parts of the skiinxaing strategy to 
preview the material, but didn't try to answer the questions. 
Ann thought about what the main ideas might be for the material 
but never made a list. Ann thought about things she didn't 
understand in the material but never made a list of questions. 

What is missing? 12 3 4 complete 

********************************************** 



********************************************** 

3. This is how Tom prepared for class the next day: 

Because Tom didn't get along well with his teacher, Tom 
guessed about what materials he needed to prepare instead of 
asking the teacher. Tom copied the answers to the questions from 
a friend. Tom thought about what the main ideas might be for the 
material but never made a list. He carefully listed a question 
about every part of the material he didn't understand. 

What is missing? 12 3 4 complete 

********************************************** 



********************************************** 

4. This is how Bob prepared for class the next day: 

Since he'd lost his class calendar. Bob ask a friend, who had 
his calendar, what materials to study. Bob read the materials. 
Bob thought about what the main ideas might be for the material 
but never made a list. He then listed the questions he had about 
the material. 

What is missing? 12 3 4 complete 

********************************************** 



**%v******** ****************** ***************** 

5. This is how Ann prepared for class the next day: 

None of Ann's friends were sure what to study, so together 
they decided what to study. Ann answered many of the questions 
after skimming the material. Ann listed all of the key points she 
could. Ann thought about things she didn't understand in the 
material but never made a list of questions. 

What is missing? 12 3 4 complete 

♦ A********************************************* 
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Appendix G 
Student Satisfaction Questionnaire 



Student Evaluation of Strategy Tutorials 

Read the following statements. Circle the number to show how much you agree with 
them. 

1. I liked the computer tutorials. 

Disagree 1 2 3 4 5 Agree 

2. I learned from the computer tutorials. 

Disagree 1 2 3 4 5 Agree 

3. I think I will use what I learned from the computer tutorials in my other classes. 

Disagree 1 2 3 4 5 Agree 

4. I would like to try more lessons like the ones I have just completed. 

Disagree 1 2 3 4 5 Agree 

Write a few sentences for each of the following: 

5. The things I like most about the computer tutorials were: 

6. The things that I would like to see changed were: 



Appendix H 
•^eacher Satisfaction Questionnaire 
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Teacher Evaluation of Strategy Tutorials 

Please consider and respond to the following questions. We will use your 
responses as a basis for revision of the products. 

1. How did you arrange your schedule to use th^s computer tutorials? 

2. Did you have difficulties operating the equipment? What difficulties did 
peer tutors have? 

3. Ho!v helpful were the tutorials? How would you change them to make them 
more helpful? 

Please consider: 

Content appropriate' 

Appropriate reading level 

Instruction/explanation: good/bad? too much/not enough? 
Examples used: good/bad? too many/not enough? 



Questions used: good/bad? too many/not enough? 



For the next two questions, a printed copy of the screens is enclosed. Please 
circle any screens that presented difficulty for students. 

4. Which sections did you like the best? Why? 



5. Which sections need improvement? Why? 



6. In what way did the tutorials help in your presentation? 



7. How did the students like the tutorials? Were they motivated to complete the 
lessons? Why, or why not? 



8. If this product was available for sale, would you buy it? Why, or why not? 



9. ^n general, were these tutorials helpftil to you as a teacher? Do you see a 
place for them? Where and for whom? 



